iteration-saturation-small-dataset-reorder/specs-cold-vecmap/1

PDF of Slope Regression

Additional Statistics:

Lower bound Estimate Upper bound
Slope 1.5252 us 1.5979 us 1.6863 us
0.7013229 0.7428595 0.6830116
Mean 1.5260 us 1.5691 us 1.6216 us
Std. Dev. 63.643 ns 125.24 ns 183.60 ns
Median 1.5099 us 1.5714 us 1.5897 us
MAD 37.065 ns 84.720 ns 138.17 ns

Additional Plots:

Understanding this report:

The plot on the left displays the average time per iteration for this benchmark. The shaded region shows the estimated probabilty of an iteration taking a certain amount of time, while the line shows the mean. Click on the plot for a larger view showing the outliers.

The plot on the right shows the linear regression calculated from the measurements. Each point represents a sample, though here it shows the total time for the sample rather than time per iteration. The line is the line of best fit for these measurements.

See the documentation for more details on the additional statistics.

Change Since Previous Benchmark

Additional Statistics:

Lower bound Estimate Upper bound
Change in time -20.328% -11.993% -4.9670% (p = 0.01 < 0.05)
Performance has improved.

Understanding this report:

The plot on the left shows the probability of the function taking a certain amount of time. The red curve represents the saved measurements from the last time this benchmark was run, while the blue curve shows the measurements from this run. The lines represent the mean time per iteration. Click on the plot for a larger view.

The plot on the right shows the two regressions. Again, the red line represents the previous measurement while the blue line shows the current measurement.

See the documentation for more details on the additional statistics.